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DETAILED ACTION 

A request for continued examination under 37 CFR 1.1 14, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 10/13/2009 has been entered. 

This communication is responsive to Amendment, filed 10/13/2009. 

Claims 1-4, 9-17, 22, 24-55, 59, 62-68, 71-72, 76, 78, 79, 81, 82, 84-87, and 90-91 are 
pending in this application. In the Amendment, claims 5-8, 18-21, 23, 56-58, 60-61, 69-70, 73- 
75, 77, 80, 83, 88, and 89 were cancelled, claims 90 and 91 were added, and claims 1, 22, 35, 54, 
63, 72, and 87 were amended. 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
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invention was made in order for the examiner to consider the applicability of 35 U.S. C. 103(c) 
and potential 35 U.S. C. 102(e), (f) or (g) prior art under 35 U.S. C. 103(a). 

Claims 1-4, 9-17, 24-32, 35-43, 47-55, 59, 62-68, 71, 72, 76, 78, 79, 81, 82, 84, 85, 86, 
87, and 91 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liles et al. 
("Liles" U.S. Pat. No. 5,880,731), Kim et al. (WO 01/84461 Al), and Day et al. ("Day", 
7,039,676). 

Per claim 1, Liles teaches a method for communicating, the method comprising: 

graphically representing, with an avatar capable of being animated, a first user in a 
communication session involving the first user and a second user (col. 3, lines 52-67); 

communicating a message between the first user and the second user, the message 
conveying explicit information from the first user to the second user (col. 3, lines 32-41); and 

communicating out-of-band information to the second user using a change in the avatar 
appearance or avatar animation as a communication conduit, wherein the out-of-band 
communication differs from the information conveyed in the message sent between the first user 
and the second user (col. 3, lines 28-42; col. 9, lines 55-65; a participant can select and animate 
the avatar related to a context of the participant along with text message sent between 
participants). 

Liles does not specifically teach receiving, from a computer application operating 
concurrently with the communication session and independently of the first user and the 
message, out-of-band information indicating an activity the first user, the computer application 
producing outputs unrelated to and independent from the communication session; and 
communicating independently of the first user and the second user, the out-of-band information 
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to the second user by changing an animation of the avatar representing the first user to 
graphically convey the activity of the first user indicated by the received out-of-band 
information. However, Kim teaches receiving, independently of the first user and the message, 
out-of-band information indicating a context of the first user and communicating, based on 
stored data association, the out-of-band information to the second user (fig. 1; page 2, lines 5- 
13). 

Day teaches receiving, from a computer application operating concurrently with the 
communication session and independently of the first user and the message (fig. 5; which shows 
automatic gesture software operating 500 concurrently with the chat room software 540) , out- 
of-band information indicating an activity the first user (fig. 5; which shows chat room software 
receives API commands of gestures (i.e. activity) of the user from conversion to API 532), the 
computer application producing outputs unrelated to and independent from the communication 
session (fig. 5; col. 3, lines 45-67; col. 6, lines 33-38; the user can interact with the automatic 
gesture software to produce gesture commands that are unrelated to and independent from the 
Chat software); and communicating independently of the first user and the second user, the out- 
of-band information to the second user by changing an animation of the avatar representing the 
first user to graphically convey the context of the first user indicated by the received out-of-band 
information (col. 3, lines 45-67; which shows automatically generating input into a chat system 
to animate a user avatar.) Therefore, it would have been obvious to one of ordinary skill in the 
art at the time of the invention to include the teaching of Kim et al., and Day in the invention of 
the modified Liles in order to provide the users with an enjoyable on-line chatting using various 
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setting for a character in the virtual world that reflect the real world setting of a user, and in order 
to automatically generating input into a chat system to animate a user avatar. 

Per claim 2, the modified Liles teaches the method of claim 1 wherein the 
communication session is an instant messaging communication session (Liles, col. 3, lines 58- 
62; online chat session). 

Per claim 3, the modified Liles the method of claim 1 wherein the avatar comprises a 
facial animation that does not include a body having an ear or a leg (Liles, fig. 7; element 124; 
col. 7, lines 49-54; a user can modify an animation to include or exclude various features). 

Per claim 4, the modified Liles teaches the method of claim 1 wherein the avatar 
comprises a facial animation, including a neck, that does not include a body having an ear or a 
leg (Liles, fig. 7; animation 122; col. 7, lines 49-54; a user can modify an animation to include or 
exclude various features). 

Per claim 9, the modified Liles teaches the out-of-band information comprises 
information indicating a setting characteristic associated with the first user (Kim, page 2, lines 5- 
14). 

Per claim 10, the modified Liles teaches the method of claim 9 wherein the setting 
characteristic comprises a characteristic related to time of day of the first user (Kim, page 2, line 
23). 

Per claim 1 1 , the modified Liles the modified Liles teaches the method of claim 9 
wherein the setting characteristic comprises a characteristic related to time of year (Kim, page 2, 
lines 5-9). 
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Per claim 12, the modified Liles teaches the method of claim 1 1 wherein the time of year 
comprises a holiday (Kim, page. 2, lines 5-9; each season comprises a holiday). 

Per claim 13, the modified Liles teaches the method of claim 1 1 wherein the time of year 
comprises a season wherein the season is one of spring, summer, fall or winter (Kim, page 2, 
lines 5-9). 

Per claim 14, the modified Liles teaches the method of claim 9 wherein the setting 
characteristic comprises a characteristic associated with a work setting (Kim, page. 2, lines 10-14 
and lines 29-34; geographic setting or physical location of the user). 

Per claims 15-17, the modified Liles teaches the method of claim 9 wherein the setting 
characteristic comprises a characteristic associated with a recreation setting such as a beach 
setting, a tropical setting, or a winter sport setting (Kim, page 2, lines 10-14 and lines 29-34; it is 
noted the geographic setting where the user lives or physical location of the user may comprises 
a recreation setting). 

Per claim 24, the modified Liles teaches the method of claim 1 further comprising 
triggering, based on the information conveyed in the message from the first user to the second 
user, an animation of the avatar to convey the out-of-band information from the first user to the 
second user (Liles, col. 7, lines 18-22; col. 9, lines 55-65 and col. 10, lines 28-32; a user can 
select an animation to convey a message to send to another user). 

Per claim 25, the modified Liles teaches the method of claim 24 wherein the trigger 
comprises a portion of text (Liles, col. 9, lines 55-65). 
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Per claim 26, the modified Liles teaches the method of claim 24 wherein the trigger 
comprises all of the text of the message (Liles, col. 9, lines 55-65 and col. 10, lines 28-32; a user 
can select an animation in response to messages sent between the users). 

Per claim 27, the modified Liles teaches the method of claim 24 wherein the trigger 
comprises an audio portion of the message (Liles, col. 9, lines 55-65 and col. 10, lines 28-32; col. 
13, lines 35-41; a user can select an animation in response to the sound when a user joins the 
chat session). 

Per claim 28, the modified Liles teaches the method of claim 24 wherein the trigger 
comprises passing a predetermined amount of time during which the first user does not 
communicate a message to the second user (Liles, col. 9, lines 24-26). 

Per claim 29, the modified Liles teaches the method of claim 24 wherein the trigger 
comprises passing a predetermined amount of time during which the first user does not use a 
computing device that is used by the first user to communicate with the second user in the 
communication session (Liles, col. 9, lines 24-26). 

Per claim 30, the modified Liles teaches the method of claim 1 communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by changing an animation of the avatar representing the first user comprises communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by modifying a facial expression of the avatar (Liles, fig. 7; Day, col. 3, lines 45-67, col. 7, 
lines 48-57). 

Per claim 31, the modified Liles teaches the method of claim 1 wherein communicating, 
independently of the first user and the second user, the out-of-band information to the second 
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user by changing an animation of the avatar representing the first user comprises communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by initiating, a gesture made by a hand of the avatar or a gesture made by an arm of the 
avatar (Liles, col. 7, lines 30-35; Day, col. 3, lines 45-67, col. 7, lines 48-57). 

Per claim 32, the modified Liles teaches the method of claim 1 communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by changing an animation of the avatar representing the first user comprises communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by initiating movement of a body of the avatar (Liles, col. 7, lines 30-35; Day, col. 3, lines 
45-67, col. 7, lines 48-57). 

Per claim 35, the modified Liles teaches the method of claim 1 wherein the avatar 
animation that graphically conveys the context of the first user comprises a breakout animation 
that involves displaying avatar outside of normal display space occupied by the avatar (Liles, col. 
7, lines 13-16 and col. 9, lines 1-5; a user can modify the avatar as desired and move avatar 
within the room). 

Per claim 36, the modified Liles teaches the method of claim 35 wherein the breakout 
animation comprises telescoping the avatar (Liles, col. 7, lines 13-16 and col. 9, lines 1-5; a user 
can modify the avatar as desired). 

Per claim 37, the modified Liles teaches the method of claim 35 wherein the breakout 
animation comprises resizing the avatar (Lilies, col. 7, lines 13-16 and col. 9, lines 1-5; a user 
can modify the avatar as desired). 
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Per claim 38, the modified Liles teaches the method of claim 35 wherein the breakout 
animation comprises repositioning the avatar (Liles, col. 7, lines 13-16 and col. 9, lines 1-5; a 
user can modify the avatar as desired and move avatar within the room). 

Per claim 39, the modified Liles teaches the method of claim 1 further comprising 
providing the first user with multiple preconfigured avatars having associated preselected 
animations and enabling the first user to select a particular avatar to represent the user in the 
communications session (Liles, col. 9, lines 34-46). 

Per claim 40, the modified Liles teaches the method of claim 39 further comprising 
persistently associating the first user with the selected avatar to represent the first user in 
subsequent communication sessions (Liles, col. 9, lines 34-46; a user can select an avatar to 
represent the user). 

Per claim 41, the modified Liles teaches the method of claim 39 further comprising 
enabling the first user to modify the appearance of the avatar (Liles, col. 9, lines 1-5). 

Per claim 42, the modified Liles teaches the method of claim 41 wherein enabling the 
first user to modify the appearance of the avatar comprises enabling the first user to use a slide 
bar to indicate a particular modification of a particular feature of the avatar (Liles, fig. 3; a user 
can use the scroll bar to select a different avatar to change the appearance of the avatar in the 
chat room). 

Per claim 43, the modified Liles teaches the method of claim 41 wherein enabling the 
first user to modify the appearance of the avatar comprises enabling the first user to modify 
appearance of the avatar to reflect a characteristic of the first user (Liles, fig. 3; col. 9, lines 1-5; 
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a user can select an avatar to reflect a characteristic of the user or modify the avatar as 
desired). 

Per claim 47, the modified Liles teaches the method of claim 1 further comprising 
enabling the first user to modify a trigger used to cause an animation of the avatar (Liles, col. 8, 
line 61 -col. 9, line 5). 

Per claim 48, the modified Liles the method of claim 47 wherein the trigger comprises 
text included in the message sent from the first user to the second user (Liles, col. 7, lines 18-22; 
col. 9, lines 55-65; a user can select animation in response to message sent between the users). 

Per claim 49, the modified Liles teaches the method of claim 1 further comprising 
animating the avatar for use as an information assistant to convey information to the first user 
(Liles, col. 7, lines 25-35). 

Per claim 50, the modified Liles teaches the method of claim 1 further comprising 
enabling use of the avatar by an application other than a communications application (Liles, col. 
9, lines 4-15; a bitmap file can be view by other application that is able to view bitmap files). 

Per claim 5 1, the modified Liles teaches the method of claim 50 wherein enabling use of 
the avatar by an application other than a communications application comprises enabling use of 
the avatar in an online journal (Liles, col. 9, lines 4-15; a bitmap file can be view by other 
application that is able to view bitmap files). 

Per claim 52, the modified Liles teaches the method of claim 1 further comprising 
displaying a depiction of the avatar in the form that is similar to a trading card (Liles, col. 9, lines 
9-15; a user can send their customized avatar to other users). 



Application/Control Number: 10/747,652 Page 11 

Art Unit: 2175 

Per claim 53, the modified Liles teaches the method of claim 52 wherein the trading card 
depiction of the avatar comprises a trading card depiction of the avatar that includes 
characteristics associated with the first user (Liles, col. 1-5; a user can customized the avatars as 
desired). 

Claims 54 and 55 are rejected under the same rationale as claims 1 and 2 respectively. 
Claim 59 is rejected under the same rationale as claim 9. 
Claim62 is rejected under the same rationale as claim 47. 

Claims 63 and 64 are rejected under the same rationale as claims 1 and 2 respectively. 
Claim 65 is rejected under the same rationale as claim 5. 

Claims 66 and 67 are rejected under the same rationale as claims 7 and 8 respectively. 
Claim 68 is rejected under the same rationale as claim 9. 

Claim 71 are rejected under the same rationale as claims 47. 
Claim 72 is rejected under the same rationale as claim 1 . 

Per claim 76, the modified Liles teaches the method of claim 1 , wherein the graphically 
representing comprises graphically representing a background display associated with an avatar 
(Liles, fig. 13; avatar 254 and associated background). 

Per claim 78, the modified Liles teaches the method of claim 1, further comprising: 
determining whether to change the avatar appearance or avatar animation to communicate the 
received out-of-band information based on other out-of-band information received independently 
of the first user and the message (Tang, col. 7, lines 55-65; col. 13, lines 57-64; col. 15, lines 5- 
15; col. 18, lines 55-67; shows changing appearance of a user). 
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Claims 79 and 81 are rejected under the same rationale as claims 76 and 78 respectively. 
Claims 82 and 84 are rejected under the same rationale as claims 76 and 78 respectively. 
Claim 85 is rejected under the same rationale as claim 20. 
Claim 86 is rejected under the same rationale as claim 52. 

Per claim 87, the modified Liles teaches the method of claim 1 wherein communicating, 
independently of the first user and the second user, the out-of-band information to the second 
user by changing an animation of the avatar representing the first user to graphically convey the 
context of the first user indicated by the received out-of-band information comprises 
communicating, independently of the first user and the second user, the out-of-band information 
to the second user by changing an animation of the avatar representing the first user to 
graphically convey the context of the first user indicated by the received out-of-band information 
based on stored data associations (Day, col. 3, lines 45-67, col. 7, lines 48-57). 

Per claim 91, the modified Liles teaches the method of claim 1, wherein the computer 
application further produces outputs related to and dependent on the communication session (fig. 
5; col. 3, lines 45-67; col. 6, lines 33-38; the user can interact with the automatic gesture 
software to produce gesture that are in response to (i.e .related to) and dependent to text 
messages from other users in the communication session) 

Claims 22, 90 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liles, 
Kim (WO 01/84461, and Day et al. ("Day", 7,039,676), and Tang et al. ("Tang", US 
6,349,327). 
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Per claim 22, the modified Liles teaches the method of claim 21, but does not 
specifically teach receiving out of band information indicating an activity of the first user 
comprises receiving out of band information indication the activity of the first user comprises 
one of working or listening to music; and communicating the out of band information to the 
second user by changing an animation of the avatar representing the first user to reflect 
respectively the avatar working or listening to music. However, Tang teaches receiving out of 
band information indicating an activity of the first user comprises receiving out of band 
information indication the activity of the first user comprises one of working or listening to 
music; and communicating the out of band information to the second user by changing an 
animation of the avatar representing the first user to reflect respectively the avatar working or 
listening to music (fig. 1; col. 5, lines 1-19; col. 7, lines 55-67; which shows communicating 
information indicating a task that the user is working on and changing user's avatar to a current 
status). Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to include the teaching of Tang in the invention of the modified Liles in order to 
enable a user to know which other users are nearby in term of type of work they are doing, such 
as the data they are accessing, the application they are using and the time when such work was 
performed. 

Claim 90 is rejected under the same rationale as claim 22. 



Claims 33 and 34 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Liles, Kim (WO 01/84461, and Day et al. ("Day", 7,039,676), and Matsuda (U.S. Pat. No. 
7,007,065). 
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Per claims 33 and 34, the modified Liles teaches the method of claim 1, but does not 
teach wherein the avatar animation that graphically conveys the context of the first user 
comprises sounds made by the avatar, and wherein at least some of the sounds comprise a voice 
based on a voice of the first user. However Matsuda teaches wherein the avatar animation that 
graphically conveys the context of the first user comprises sounds made by the avatar, and 
wherein at least some of the sounds comprise a voice based on a voice of the first user (col. 1, 
lines 8-10; col. 3, lines 30-34; col. 5, lines 50-55). Therefore, it would have been obvious to one 
of ordinary skill in the art at the time of the invention to include the teaching of Matsuda in the 
invention of the modified Liles in order to provide an avatar that is active in a shared virtual 
space, and made to output a sound during a chat. 

Claims 44-46 are rejected under 35 U.S.C. 103(a) as being unpatentable over Liles, 
Kim, Day, and Ostermann et al. ("Ostermann", U.S. Pat. No. 7,177,811). 

Per claims 44-46, the modified Liles teaches modification of the appearance and 
characteristic of a user as described above, but does not specifically teach wherein the 
characteristic of the first user comprises one of age, gender, hair color, eye color, or a facial 
feature, the appearance of the avatar comprises enabling the first user to modify appearance of 
the avatar by adding, changing or deleting a prop displayed with the avatar, and wherein the prop 
comprises one of eyeglasses, sunglasses, a hat, or earrings. However, Ostermann teaches teach 
wherein the characteristic of the first user comprises one of age, gender, hair color, eye color, or 
a facial feature, the appearance of the avatar comprises enabling the first user to modify 
appearance of the avatar by adding, changing or deleting a prop displayed with the avatar, and 
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wherein the prop comprises one of eyeglasses, sunglasses, a hat, or earrings (fig. 9; col. 11, line 
60-col. 12, line 8). Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to include the teaching of Ostermann in the invention of the modified Liles 
in order to provide further customizations to the user's avatar in a chat session. 



Response to Arguments 

Applicant's primary argument is that Day does not teach the claimed features of 
"receiving, from a computer application operating concurrently with the communication session 
and independently of the first user and the message, out-of-band information indicating an 
activity the first user, the computer application producing outputs unrelated to and independent 
from the communication session". 

The examiner does not agree for the following reasons: 

During patent examination, the pending claims must be "given >their< broadest 
reasonable interpretation consistent with the specification." > In rc Hyatt, 21 1 F.3d 1367, 1372, 
54 USPQ2d 1664, 1667 (Fed. Cir. 2000). Although the claims are interpreted in light of the 
specification, limitations from the specification are not read into the claims. See In re Van 
Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

Applicant always has the opportunity to amend the claims during prosecution, and broad 
interpretation by the examiner reduces the possibility that the claim, once issued, will be 
interpreted more broadly than is justified. In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 
550-51 (CCPA 1969). 
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In this case, Day reads on the claimed limitation of receiving, from a computer 
application operating concurrently with the communication session and independently of the first 
user and the message (fig. 5; which shows automatic gesture software operating 500 
concurrently with the chat room software 540), out-of-band information indicating an activity 
the first user (fig. 5; which shows chat room software receives API commands of gestures (i.e. 
activity) of the user from conversion to API 532), the computer application producing outputs 
unrelated to and independent from the communication session (fig. 5; col. 3, lines 45-67; col. 6, 
lines 33-38; the user can interact with the automatic gesture software to produce gesture 
commands that are unrelated to and independent from the Chat software). 

Inquiries 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to THANH T. VU whose telephone number is (571)272-4073. The 
examiner can normally be reached on Mon- Fri 7:00 AM - 3:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William L. Bashore can be reached on (571) 272-4088. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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